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Abstract 

For a hypergeometric series /(/c, a, 6, . . . , c) with parameters 
a,b, . . . ,c, Paule has found a variation of Zeilberger's algorithm to es- 
tablish recurrence relations involving shifts on the parameters. We 
consider a more general problem concerning several similar hyperge- 
ometric terms fi{k,a,b, ... ,c), f2{k,a,b, ... ,c), fmik,a,b, ... ,c). 
We present an algorithm to derive a linear relation among the sums 

fi{k,a,b, . . . ,c) (1 < i < m). Furthermore, when the summand 
fi contains the parameter x, we can require that the coefficients be 
j;-free. Such relations with x-free coefficients can be used to determine 
whether a polynomial sequence satisfies the three term recurrence and 
structure relations for orthogonal polynomials. The (^-analogue of this 
approach is called the extended g-Zeilberger's algorithm, which can 
be employed to derive recurrence relations on the Askey- Wilson poly- 
nomials and the g-Racah polynomials. 

Keywords: Zeilberger's algorithm, the Gosper algorithm, hypergeometric 
series, orthogonal polynomials 

AMS Subject Classification: 33F10, 33C45, 33D45 



1 



1. Introduction 



Based on Gosper's algorithm, Zeilberger [14, 16] has developed a power- 
ful theory for proving identities on hypergeometric series and basic hyper- 
geometric series. Let F{n, k) be a double hypergeometric term, namely, 
F{n + 1, k)/F{n, k) and F{n, k + 1)/F{n, k) are both rational functions of 
n and k. Zeilberger's algorithm is devised to find a double hypergeometric 
term G{n, k) and polynomials aoin), ai(n), . . . ^amiji) which are independent 
of k such that 

ao(n)F(n, k)+ai{n)F{n+l, k)-\ ham{n)F{n+m, k) = G{n, k+l)-G{n, k). 

(1.1) 

Writing 

oo 

S{n) = Y,nn,k). 

k=0 

Summing (11.11) over k, we deduce that 

ao{n)S{n) + ai{n)S{n + l)-\ ham{n)S{n + m) = G{n,oo)-G{n,0). (1.2) 

Thus the identity 

oo 

J2F{n,k) = f{n) (1.3) 

fc=0 

can be justified by verifying that f{n) also satisfies (11.21) and both sides of 
(11.31) share the same initial values. 

Paule [12] extended Zeilberger's algorithm to the multi-variable case and 
found many applications. Let n denote the vector of variables (ni, . . . ,71^) 
and F{n, k) be a multi- variable hypergeometric term, that is, 

F(ni + l,n2, . . . ,nr, fc) F(ni, n2, . . . , 1, fc) F(ni, n2, . . . , n^, + 1) 
F(ni,n2, . . . ,nr, fc) F(ni, n2, . . . , n^, fc) ' F(ni, n2, . . . , n^, fc) 

are all rational functions of n and k. Given m shifts 'ji, . . . , 7,^ G Z*" of the 
variables n, he found that one can use a similar procedure to Zeilberger's al- 
gorithm to find a multi- variable hypergeometric term G{n, k) and coefficients 
ai(n), . . . , amin) which are independent of k such that 

m 

ai{n)F{n + 7,, k) = G{n, k + 1) - G(n, k). (1.4) 

i=l 
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The main idea of this paper is the observation that Paule's approach can 
be further extended to a more general telescoping problem. Let fi{k, a,b, . . . ,c), 
. . ., fm{k,a,b, . . . ,c) he m similar hypergeometric terms of k with parameters 
a,b, . . . ,c, namely, the ratios 

fi{k,a,b, ■ ■ ■ ,c) fi{k + l,a,6, ■ ■ ■ ,c) 

fj{k,a,b,...,c) fi{k,a,b,...,c) 

are all rational functions of k and a,b, . . . ,c. Find a hypergeometric term 
g{k, a,b, . . . , c), that is, the ratio g{k + 1, a, 6, ... , c)/g{k, a, 6, . . . , c) is a ra- 
tional function of k and a,b, . . . ,c, and polynomial coefficients ai(a, b, . . . ,c), 
02(0, fc, . . . , c), . . ., ttmiciyb, . . . ,c) which are independent of k such that 

aifiik) + a2f2{k) + ■■■ + a^f„,{k) = g{k + 1) - g{k). (1.5) 

For brevity, from now on we may omit the parameters a, 6, . . . , c and write 
fi{k) for fi{k, a,b, . . . ,c), for aj(a, 6, . . . , c), and g{k) for g{k, a,b, . . . ,c). 
Once the telescoping relation fll.51) is established, summing over k often leads 
to a homogenous relation among the sums fi{k), . . ., J2k fmik): 

«i fiik) + 02 XI /2(^) + ■ ■ ■ + am XI •^™^^) = 0- 

Let -F(n, /c) be a multi- variable hypergeometric term and 7^ G Z^'. Then 
n) = F(n + 7^, k) are similar hypergeometric terms of k with param- 
eters rii, . . . ,nr. Therefore, Paule's equation fll.4p is a special case of fll.Sp . 
However, we should note that the extended Zeilberger's algorithm is very 
much in the spirit of the original algorithm of Zeilberger, and it should be 
regarded as a variation as well because the implementation of the extended 
algorithm is essentially the same as the original algorithm. 

As an application of our algorithm, one can determine whether a given 
hypergeometric series satisfies the recurrence relation and the structure re- 
lations for orthogonal polynomials. Meanwhile, we obtain the coefficients in 
these relations. For instance, let Pn{x) = Ylik ■^ri,k{,x) be the hypergeometric 
representation of the Jacobi polynomials as given in (13.31) . Set 

h{k) = p„,,(x), h{k) = PUi,ki^), h{k) = p;,(x), u{k) = p^i,,(x), 

where i^{x) denotes the derivative of Pn,k{x) with respect to x. The ex- 
tended Zeilberger's algorithm enables us to find the structure relation for 

Pn{x) 

Pn{x) = anPUli^) + bnP'Ax) + CnP'n-A^) ■ (1-6) 
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It is worth mentioning that neither the original Zeilberger's algorithm nor the 
variation of Paule is directly applicable to the above relation fll.6p involving 
derivatives. 

Furthermore, it is important to impose an additional requirement that 
the coefficients ai,...,am in (11-51) are not only independent of k but also 
independent of some other parameters such as the variable x occurring as 
the variable of orthogonal polynomials. For example, a„, 6„ and c„ in (11.61) 
are required to be independent of the variable x. Based on this parameter- 
free property of the coefficients, Chen and Sun [6] have developed a computer 
algebra approach to proving identities on Bernoulli polynomials and Euler 
polynomials. 

We should notice that Koepf and Schmersau [10] have shown that one can 
derive the recurrence relation and structure relations for orthogonal polyno- 
mials by variations of Zeilberger's algorithm. For each of the three kinds 
of relations, they have provided an algorithm. The extended Zeilberger's 
algorithm serves as a unification of their algorithms and applies to more 
general cases. For instance, our algorithm can also be used to derive recur- 
rence relations for the connection coefficients between two classes of Meixner 
polynomials with different parameters. 

In another direction, the extended Zeilberger's algorithm can be adapted 
to deal with basic hypergeometric terms. Using the g-analogue of this al- 
gorithm, we can recover the three term recurrence relations for the Askey- 
Wilson polynomials and the g-Racah polynomials. 

Let us recall some terminology and notation. A function t{k) is called a 
hypergeometric term if t{k + l)/t{k) is a rational function of k. A hyperge- 
ometric series is defined by 



where (a)^ = a{a + 1) ■ ■ ■ (a + A; — 1) is the raising factorial. The g-shifted 
factorial is given by (a; q)k = (1 — a)(l — aq) ■ ■ ■ (1 — aq^~^) and we write 




fc=0 



(ai, . . . , a^; q)k = {ai, q)k - ■■ (a-m; q)k- 
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Then a basic hypergeometric series is defined by 



ai, . 






. h,. 




q;z 



E 

fe=0 



{bi,---bs;q)k {q;q)k 



s~r+l 



2. The Extended Zeilberger's Algorithm 

Let fi{k), f2{k), . . . , fm{k) be similar hypergeometric terms with parameters 
a,b, . . . ,c. Recall that two hypergeometric terms f{k) and g{k) are said to 
be similar if their ratio is a rational function of k and the parameters. We 
assume that 

+ - !^ and ^ - ^ ^ - 1 2 m (2 1) 

where u{k),v{k),Pi{k), Q{k) are polynomials in k and the parameters a,b, . . . ,c. 
Suppose that fi{k) satisfy fl2.ip . Then 

fi{k + l) ^ /,(fc + l)//i(A: + l)/i(A; + l) ^ p,{k + l)Q{k)u{k) 
m m/Mk) h{k) p,{k)Q{k + l)v{k) 

and 

m _ mifrn _ p,{k) 
m m/Mk) p,{k) 

are rational functions of k and a,b, . . . ,c. Thus (12. ip is equivalent to the 
statement that fi{k), f2{k), . . . , fm{k) are similar hypergeometric terms. 

Our aim is to find coefficients ai, . . . , as rational functions in the pa- 
rameters a,b, . . . ,c but independent of k (called k-free coefficients) such that 

ajiik) + a2f2{k) + ■■■ + a^U{k) = g{k + 1) - g{k) (2.2) 

for some hypergeometric term g{k) with parameters a,b, . . . ,c. By the simi- 
larity oi fi{k),...Jmik), 

tk = aifi{k) + a2f2{k) H h amfm{k) (2.3) 

is a hypergeometric term of k with parameters a, 6, . . . , c. So we can apply 
Gosper's algorithm [8] to find g{k) such that tk = g{k + 1) — g{k). Notice 
that we always have a trivial solution ai = a2 = ■ ■ ■ = = and g{k) = 0. 
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Notice that by multiplying the common denominator, the coefficients 
Oi, . . . , in fl2.2l) become polynomials in the parameters a,b, . . . ,c. If no 
confusion arises, we may not mention the parameters a,b, . . . ,c. In the usual 
case n is the parameter for identities on finite sums. 

It follows from fl2.3p that 

tfc+i ^ f^ik + l)J:Z^a^f^{k + l)/f^{k + l) 

tk fl{k) YZl<^^m/h{k) 

_ u{k)Q{k) YlT^iO-iPiik + I) 



Suppose that 



v{k)Q{k + l) Etl(^^Mk) 
u{k)Q{k) a{k)c{k + l) 



v{k)Q{k + l) b{k) c{k) 

is a Gosper representation, i.e., a{k),b{k),c{k) are polynomials such that 
gcd{a{k),b{k + h)) = 1 for all non-negative integers h. Then a Gosper rep- 
resentation of tk+i/tk is given by 

tk+i _ a{k) c{k + l)P{k + l) 
tk ~ b{k) c{k)P{k) 

where 

m 

P{k) = Y,^^V^{k). (2.4) 

i=l 

Gosper's algorithm states that g{k) exists if and only if there exists a poly- 
nomial x{k) such that 

a{k)x{k + 1) - b{k - l)x{k) = c{k)P{k). (2.5) 

Moreover, the degree bound d for x{k) can be estimated by a{k) and b{k). 
Suppose 

d 

x{k) = y^Qfc". 

1=0 

By comparing the coefficients of each power of k on both sides, we obtain a 
system of linear equations on ai, . . . , Om and cq, ci, . . . , q. Solving the system 
of linear equations, we find coefficients ai, . . . , and 

K^-oMfc) 
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The extended Zeilberger's algorithm can be described in terms of the 
following steps. 

Input: m similar hypergeometric terms fi{k), . . . , fmik). 

Output: /c-free coefficients ai,a2,...,am and a hypergeometric term g{k) 

satisfying (12.21) . 



1. Compute the rational functions 



fi{k) ' ' h{k) 

Set Q{}i) to be the common denominator of ri(A;), . . . ,rm(fc), 

and let P{k) be given by (M . 
2. Compute a Gosper representation of 

Q{k) a(fc)c(fc + l) 



r{k) 



Q(A;+1) h{k) c{k) 



3. Compute the degree bound d for and solve the equation ( 12. 5p by 
the method of undetermined coefficients to obtain the /c-free coefficients 
ai, . . . , Om and the polynomial 

4. The hypergeometric term 5f(/c) is then given by 

6(/c - l)a;(/c) 



Suppose that F{n,k) is a double hypergeometric term. Let = 
F(n + 2 — 1, k). Then the extended Zeilberger's algorithm reduces to the orig- 
inal Zeilberger's algorithm. More generally, suppose that n = (ni, . . . ,rij,), 
F{n,k) is a multi-variable hypergeometric term and 7^ G Z*". The special- 
ization fi{k) = F{n + 7j, /c) reduces to Panic's variation. 

As will be seen, in some applications it is necessary to require that the 
coefficients be independent of some parameters, say, the parameter 
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a. More precisely, let fi{k, a,b, . . . ,c), . . ., fm{k, a,b, . . . ,c) be m similar 
multi-variable hypergeometric terms, that is, 

fi{k + l,a,6, ■ ■ ■ ,c) fiik,a,b, . . . , c) ^ 

fi{k,a,b,...,c) fi{k,a,b,...,c) 

are rational functions of k,a,b, . . . , c. We aim to find ai, 02, . . . , not only 
independent of k but also independent of the parameter a such that (12.21) 
holds. 

Since the solutions (ai, . . . ,am,g{k)) of (12.21) form a linear vector space, 
we may use the following form as the output 

ai = Vi, . . . jttr = Vr, 

ttr+l = K+l{Vi, . . .,Vr), ...,am = h„^{Vl, . . .,Vr), (2.7) 
g(k) = h{Vi,. . .,Vr)fl{k), 

where vi, . . . ,Vr are free variables and /ir+i, ■ ■ ■ ,hm,h are linear combinations 
of Vi, . . . ,Vr- For this purpose, we should first ignore the independence of a 
and apply the extended Zeilberger's algorithm to find the solution (12. 7p . By 
(12.61) . the functions hr+i, . . . , are rational functions of the parameters 
a,b, . . . ,c and thus can be written as 

hi = pi{a, b, . . . ,vi, . . . , Vr)/qi{a, b,...,c), 

where pi, qi are relatively prime polynomials. Now consider the additional 
requirement that Oi, a2, . . . , are independent of the parameters a. There- 
fore, all the coefficients of 

Pi{a, b, . . . ,c,vi, . . . ,Vr) - aiQi^a, b,...,c) 

in variable a must be zero. This gives a system of linear equations on 
ai, . . . , Om and vi, . . . ,Vr. Upon solving these equations, we eventually find 
ai,a2, ■ ■ ■ ,am which are independent of k and the parameter a. The above 
version of the extended Zeilberger's algorithm will still be called the extended 
Zeilberger's algorithm. 

Let us take the Hermite polynomials as the first example to show how to 
use the above algorithm to derive linear relations on sums of similar hyper- 
geometric terms with parameters. 
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Example 2.1 The Hermite polynomials i?„(x) are given by 



n n—1 

Hn{x) = {2xr 2FA 2' 2 



(2.8) 



see [2, Section 6.1]. We aim to find a three term recurrence 

xHn{x) = anHn+i{x) + /5„i?„(x) + 7„if„_i(a;) 
with coefficients anyPnyln being independent of x. Let 



Hn,k{x) = (2x) 



nV 2/fcV 2 yfc/ 



/c! V x' 



r-2 



k 



be the summand in (12.81) . We ffist ignore the x-freeness requirement and 
apply the extended Zeilberger's algorithm to the four similar hypergeometric 
terms with parameters n and x 

fi{k) = xHn,k{x), f2{k) = Hn+i,k{x), fsik) = Hn,k{x), h{k) = Hn-i^k{x). 
We find that 

ai = wi, a2 = f2, as = -x{vi + 21^2), 04 = 2?7.f2, (2.9) 

and 

9{k) = -Z^^xHr.,u{x). (2.10) 

Now it is time to impose the x-freeness condition to give an additional equa- 
tion 

vi + 2v2 = 0. 

Hence we obtain 

ai = vi, a2 = - — , ag = 0, 04 = -nvi, g[k) = ^ _^ ^ _ ^^ xHn^k[x). 
It follows that 

vixHn,k{,x) - yiJ„+i,fc(x) - nviHn-i,k{.x) = g{k + 1) - g{k). 
Summing over k, we deduce that 

xHn{x) = ^Hn+lix) +nHn-l{x). 
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3. Orthogonal Polynomials 



Using the extended Zeilberger's algorithm, we can determine whether a hy- 
pergeometric series satisfies a three term relation and the structure relations 
for a sequence of orthogonal polynomials. In other words, one can verify the 
orthogonality of a terminating hypergeometric series by using the extended 
Zeilberger's algorithm. 

The method to derive the relation in Example 2.1 is in fact valid in the 
general case. Given a hypergeometric series Pn{x), we can compute the 
coefficients for the following recurrence relation 

xPn{x) = a„P„+i(x) + PnPn{x) + 7„P„-i(a;). 

Let Pn{x) = ^^i^Pn^kix), where Pn,k{x) is a hypergeometric term of k with 
parameters n and x. Set 

fl{k) = xPn,k{x), f2{k) = P„+l,fc(x), fsik) = Pn,k{x), fi{k) = P„_i,fe(x). 

Clearly, /i, /2, /s and are similar hypergeometric terms. So we can use the 
extended Zeilberger's algorithm to find 01,02,03,04 which are independent 
of k and x such that 

aixPn,k{x) + 02P„+i,fc(x) + a^Pn^kix) + 04Pn-i,fc(a;) = g{k + 1) - g{k). 

Then summing over k leads to 

ttn = -02/01, (3n = -O3/O1, 7„ = -O4/01. 

By this method, we can recover the three term recurrences for the La- 
guerre polynomials, the Jacobi polynomials, the Charlier polynomials, the 
Meixner polynomials, the Kravchuk polynomials and the Hahn polynomials, 
as listed in the following table. Notice that we have adopted the notation 
in [9]. 
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monic OPs 



coefficients {on = 1) 



Laguerre 


f3n = 


Jacobi 








1 


Jn 


Charlier 
Cn{x', a) 


f3n = 


Meixner 
Mnix;b, c) 




Krawtchouk 




>n 


Knix;p, N) 


1 


7n 



Hahn 

Qnix;a,b, N) 



-{a-b){a+b) 



(2n+2+a+b) (2n+a+fe) 

4{n+b){a+n){n+a+b)n 
(2n+a+b+l){2n+a+b-l){2n+a+b)^ 

(3n = a + n, 'jn = an 



cb + nc + n 



7n 



nc{b + n — 1] 



Pn 



In 



{b+a+2n'^+2n+2nb+2na+a'^+ab)N-n{a-b){n+a+b+l) 
{2n+a+b) {2n+2+a+b) 

n{N-n+l)(n+b){a+n){n+a+b){a+b+N+l+n) 
(2n+a+6+l){2n+a+fe-l)(2n+a+6)2 



Example 3.1 The Wilson polynomials Wn{x) are given by 

4-^3 



Wnix') 



(a + b)n{a + c)„(a + d)n 



n,n + a + b + c + d — l,a + xi,a — xi 
a + b,a + c,a + d 



where i = y/'^, see [15]. Let Wn,k{x^) be the summand of the right hand side 
multiplied by the factor (a + 6)n(a + c)„(a + d)n- Applying the the extended 
Zeilberger's algorithm to the similar terms 

Mk) = x'WnA^^), Mk) = Wn+i,k{x'), h{k) = Wn^ix"), U{k) = Wn.^,k{x'), 
we obtain the following relation, see also [9, p. 24] 

xWnix) = anWn+lix) + /?„Vr„(x) + -fnWn-l{x), 

where 



a+b+c+d+n— 1 



Ctr. 



{a + b + c + d + 2n){a + b + c + d + 2n - 1] 
11 



/3r, 



An'^ -A{l-a-b-c-d)n+{a + b + c + df - 2{a^ + 1)^ + 0^ + d?) 

8 



+ 



{a + h + c + d-2){a + h- c- d){a + c-h- d){a + d-h- c) 
8(a + 6 + c + (i + 2n)(a + 6 + c + d + 2ra - 2) 



and 



7„ = —(a + h + n — l){a + c + n — l){a + d + n — 1) 

{h + c + n-l){b + d + n-l){c + d + n-l)n 



X 



{a + h + c + d + 2n-l){a + h + c + d + 2n-2) 
Example 3.2 The Racah polynomials Rn{x) are given by 



Rn{x{x + C + d + 1)) = 4F3 



-n, n + a + b + 1, —x, x + c + d + 1 
a + l,b + d+ l,c+ 1 



1 , 



see [4]. The extended Zeilberger's algorithm gives the recurrence relation of 
the Racah polynomials [9, p. 27] 



where 



a. 



xRn{x) = anRn+l{x) + (3nRn{x) + 7„-R„_l(x) 



{a + n + l){c + n + l){a + h + n + l){d + h + n + l) 
(a + 6 + 2n + l)(a + 6 + 2n + 2) 



(in 



-An^ - 4:{a + b + l)n + {a - 2d - b - 2 - 2c){a - b) 

8 

(c + + + 1) (a - b){a + b){a-2d- b){a -2c + b) 



and 



In 



2 8{a + b + 2n){a + b + 2n + 2) 

{b + n){a — d + n){a + b — c + n)n 
{a + b + 2n){a + b + 2n + l) 



Example 3.3 Askey and Ismail [3] provided two hypergeometric represen- 
tations for the Pollaczek polynomials: 



Pn{x) = r/"2Fi 



b/a 



arj 



12 



C2Fl 



-n,b{( - x)/^, 
b/a 



1 



where 



^= v/(l + a)2x2 - 4a, r] = {{1 + a)x - 0/2a, ( = {{1 + a)x + 

Using the extended Zeilberger's algorithm, we derive the following three term 
recurrence from either representation [3]: 



xPji (x) 



an + h n 

—— —Pn+l{x) + — - 

+ ajn + (1 + a)n + o 



We continue to show that the extended Zeilberger's algorithm can be 
employed to express the derivatives of orthogonal polynomials in terms the 
original polynomials, and vice versa. Let Pn,k{x) be the summand of the hy- 
pergeometric representation of P„(x) and /^{x) be the derivative of Pn,k{.x). 
It is easily seen that Pnki^) is similar to Pn,k{x)- This enables us to derive 
the three term recurrence for P^ix) and the structure relations for Pn{x) as 
given below 

a{x)P^{x) = anPn+lix) + hnPn{x) + CnP„-l(x), (3.1) 

and 

Pn{x) = anP'nAx) + KP'^^ix) + C„P^i(x), (3.2) 

where (j{x) is a polynomials in x of degree less than or equal to 2 and 
ttnybn, Cn,an,bn,Cn are constants not depending on x. To derive (13. ip . we 

set 

/l(fc) = a(x)P;,(x), Uk) = Pn+lA^), Uk) = P„,fc(x), U{k) = Pn-lA^). 

To establish (13.21) . we set 

Mk) = P^4x)j2{k) = PUi,ki^), h{k) = P;,(a;), U{k) = P;_i,,(a:). 



Example 3.4 The monic Jacobi polynomials are given by 



Pnix) 



[a + l)n2" 

(n + a + 6 + 1), 



2P1 



-n, n + a + 6 + 1 
a + 1 



1 — X 



(3.3) 
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Let Pn,k{x) denote the summand. Its derivative with respect to x equals 

(a + l)n2" (-n),(n + a + &+l)fc 
"•'^"^^ (n + a + 6+l)„ 2{a+l)u{k-l)\ \ 2 

Consider the four similar terms 

h{k) = xP^x), f2{k) = h{k) = P;,(a;), U{k) = P'^.,^,{x). 

By the extended Zeilberger's algorithm with parameters n and x, we find 
that 

:,P'U)-^^P' (a + 2 + 6)(a-6) 

^^-^^^ - ^ + + 2 + a + 6)(2n + a + 6) 

4?7,(6 + ra) (a + n) (n + a + 6 + 1) 



(2n + a + 6 + l)(2n + a + 6 - l)(2n + a + 



(l-x')P'(x)--nP .(x) I 2n(Q-^)(^ + Q + fe+l) p ^ . 
(1 ^^.+i(^)+^2n + 2 + a + 6)(2n + a + 6)^"^'^^ 

4:{n + b){a + n){n + a + b + l){n + a + h)n 



+ 



(2n + a + 6 + l)(2n + a + 6 - l)(2n + a + 6)2 



Pn^i{x). 



and 

Pn{x) 



^P' (X) I - 

n + 1 ^ (2n + 2 + a + fc)(2ra + a + 6) 

4(n + 6)(a + n)n 



PLix) 



{2n + a + b + l){2n + a + b - l){2n + a + b) 



r-Pn-i(^)- 



The following example is concerned with expressing the shifts of orthog- 
onal polynomials with parameters in terms of the original polynomials and 
their derivatives. 



Example 3.5 Let 



(a + 1)„2" 



{n + a + b + l)n 



-n^n + a + b + \ 
a + 1 



1 — X 
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be the Jacobi polynomials, see [2,9]. By applying the extended Zeilberger's 
algorithm to fi{k) = Pn"'k^'''\x) {fi{k) = P!fk'''^^\x) , respectively) and 

we are led to the known relations due to Koepf and Schmersau [10] 

p(a+l,fe)/ ^ _ _J_p{'^<b),. , 2(a + 1 + n) p{a,b)f( 

n + 1 ^^^+ (2^_^2 + a + 6)(2r2 + a + 6+l) " ^ ^ 

and 

p{a,b+l)(^) _ _J_p(^'b)'(^) 2(6+ 1 + n) p(a,6)// N 

^ ^"n + 1 ^ ^ (2n + 2 + a + 6)(2n + a + 6+l) " ^ 

Moreover, we can deduce the following relations which seem to be new: 

p(a+l, fe-1) / N _ 1 p{a, b) u . 4(a + 1 + n) , ft) 

n + 1 (2n + 2 + a + o) (2n + a + o) 

4(a + 1 + n){a + n)n p{a,b) n ^ 

{2n + a + b-l){2n + a + b + l){2n + a + by 

and 

p(a-l,fe+l)^^N _ ^ pKfe)/f^^ 4(fe + 1 + n) p(a,fe)// N 

^ ^ n + 1 ^ ^ (2n + 2 + a + 6)(2n + a + 6) " ^ ' 

, 4:{b+l + n){b + n)n p^^'^^'fx) 

{2n + a + b-l){2n + a + b + l){2n + a + by ""^ ^ ^' 

The extended Zeilberger's algorithm can also be employed to compute 
the connection coefficients of two sequences of orthogonal polynomials. Ron- 
veaux [13] developed an approach to computing recurrence relations for the 
connection coefficients. The extended Zeilberger's algorithm serves this pur- 
pose without resorting to the properties of the orthogonal polynomials. As an 
example, let us consider the connection coefficients of two classes of Meixner 
polynomials with different parameters. 

Example 3.6 Let Mi^'''\x) be the monic Meixner polynomials defined by 
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i-i 



see [9, p. 45]. We wish to find a recurrence relation for tlie connection coeffi- 
cients Cm{n) defined by 

n 

Mi^'^\x) = J2Cm{n)Mj^'-^\x). (3.4) 

m=0 

To this end, we first find a difference operator which ehminates M^'^\x). 
This goal can be achieved by applying the extended Zeilberger's algorithm 
to the similar terms 

fiik) = Ml7)(x), f2{k) = Miy\x + 1), and Mk) = M^:f{x - 1), 

where 



From the telescoping relation generated by the extended Zeilberger's algo- 
rithm, we deduce that 

(x/i + /i7 + x-n + n/i)M^^'^)(x)-/i(7 + x)M^^'^)(x + l)-a;M^^''^)(x-l) = 0. 
Let 

Sra{x) = {xfi+fi-f+x-n+nfi)M^^'''\x)-fi{-f+x)M^^'''\x+l)-xM^'''\x-l), 

which can be used to establish a linear relation on the connection coefficients 
Cm{n). Indeed, it follows from fl3.4l) that 

n 

Y,CMSUx)=0. (3.5) 

m=0 

Suppose that we can express Sm{x) in terms of a suitable basis {Pm{x)}: 

Sm{x) = amPm+l{x) + hmPm{x) + CmPm-l{x), (3.6) 

where am,bm and Cm are independent of x. Substituting (13.61) into (13.51) . by 
the linear independence of Pm{x) for m = 0, 1, 2, . . ., that is, the coefficients 
of Pi{x) are all zeros, we find 

am-iCm-i{n) + hmCm{n) + Crn+lCm+l{n) = 0. (3.7) 
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Thus the question has become how to find the polynomials Pmix) in order 
to determine the coefficients a^, and c^- In view of the relation fl3.6p . we 
consider a hypergeometric term Pm{x) that is similar to Sm{x) so that we 
can solve the equation 

by using the extended Zeilberger's algorithm. In fact, we may choose 

P^x) = A{Mj^'-^\x)) = Mi^'^)(x + 1) - M(f'^)(x). 

It is easily checked that Pm{x) satisfies (13.61) and the corresponding coeffi- 
cients are given by 

(/i — l){n — m) {u — ii){5 + m — l)mu 

m + 1 (1 — vy 

—viim — mfi + 2mz/ + z//i7 — i/n + uS — u + fi — ufi6 — ^'j + vn^ 



Hence we have derived a recurrence relation (13. 7p for the connection coeffi- 
cients Cmin). 



4. g-Orthogonal Polynomials 

The extended Zeilberger's algorithm can be readily adapted to basic hyperge- 
ometric terms tk with parameters a,b, . . . ,c, that is, the ratio of two consecu- 
tive terms is a rational function of and the parameters. The g-analogue of 
the extended Zeilberger's algorithm will be called the extended g-Zeilberger's 
algorithm. Let fi{k), /2(fc), • • • , /m(^) be similar g-hypergeometric terms, 
namely, 

m/f,ik) and fi{k + l)/m{l<t,j<m) 

are rational functions of and the parameters. The objective of the ex- 
tended g-Zeilberger's algorithm is to find a g-hypergeometric term g{k) and 
coefficients Oi, 02, . . . , which are independent of k such that 

aifiik) + a^fiik) + ■■■ + a^fmik) = g{k + 1) - g{k). (4.1) 
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The detailed description of the extended g-Zeilberger's algorithm is similar 
to that of the ordinary case, hence is omitted. We will only give examples to 
demonstrate how to use this method to compute the three term recurrences 
and structure relations for g-orthogonal polynomials. 

Example 5.1 The discrete g-Hermite I polynomials are given by [1] 

Hn{x) = g(^) 201 

Let dHn{x) = ^''^(^S^}^^ be the g-difference of Hn{x). We derive that 

1 — rj" 

xdH^ix) = l-dH^+,{x) + q^-\l - q^)dH^^,{x) 

1 — 5"-+^ 



q X ^ 







g; —qx 





and 



1 - g" 

dHn{x) = if„_i(x). 

1 - q 



Example 5.2 The Askey- Wilson polynomials p„,(x; a, 6, c, d\q) are defined by 

g~", abcdq^'^, ae*^, ae"*^ 



a^Pn{x; a, 6, c, d\q) 
{ab, ac, ad; g)„ 



ah, ac, ad 



q;q 



, X = cos 9, 



see [7, (7.5.2)]. Let tn,k{x) be the summand of the right hand side multiplied 
by {ab,ac,ad]q)n/a"'. Applying the extended g-Zeilberger's algorithm to 

fl{k) = Xtn,k{x), f2{k) = tn+l,kix), f'i{k) = tn,fc(x), U{k) = tn-l,kix), 

we find that 

XPn(x) = anPn+l{x) + PnPn{x) + InPn-lix), 

where 



ar, 



1 — ahcdq 



n-l 



2(1 - abcdq^^){l - abcdq^^-^) ' 

q^~^ {abcdq'^"~^ + l)((a + 6 + c + d)q + bed + acd + abd + abc) 
2(1 - abcdq^''){l - abcdq^""-^) 
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g,2n 2j^]^ _|_ q'j(^(^i)Q(i _|_ + abd + a6c)g + abcd{a + b + c + d)) 



2(1 - abcdq^''){l - abcdq 



2n-2^ 



and 



7„ = (1 - - a6g"-^)(l - acg"-^)(l - adq''~^) 

(1 - 6cg"-^)(l - Mg"-i)(l - cdg""^^ 



X 



2(1 - a6crfg2n-i)(i _ abcdq^^-^) 

Example 5.3 The g-Racah polynomials Rn{x] a, b, c, d\q) are given by 

abq^^^, g"^', cdq^^^ 



Rn{q + cdq^^^]a,b,c,d\q) = 4^ 



g;g 



see [9, p. 122]. The extended g-Zeilberger's algorithm gives the following re- 
currence relation first derived by Askey and Wilson [4] using a transformation 
formula on a 807 series: 



where 



xRn{x) = anRn+lix) + /3„i?n(x) + 7„i?„_i(x), 

(1 - ag"+i)(l - a&g"+^)(l - Mg"+^)(1 - cg"+^) 



;i -aV+^)(l-a6g 



2n+2^ 



q^+^ {abq^'^^^ + l){c + bed + dc + a + bd + ab + ca + abd) 
(l-a6g2")(l-a6g2"+2) 

g2"+^(l + q){ab^d + abed + ca + bed + aM + a6 + abc + a^ft) 
(1 - a6g2")(l - abq^'^^^) 



and 



7n 



(1 - g")(l - 6g")(c - a6g")(c/ - ag'*)g 
(l-a6g2")(l-afeg2"+i) ' 
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